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Abstract  -  Distributed  target  tracking  and  identification  is 
an  important  element  of  operational  environments.  In  this 
paper,  we  develop  a  fidelity  metric  of  track  purity 
assessment  using  confusion  matrix  (CM)  fusion.  We  assess 
individual  distributed  tracker  track  purity  associations  for 
a  multitarget  scenario  from  two  platforms.  The  fidelity’ 
metric  for  each  tracker  is  combined  using  the  CM  fusion 
for  track  decision-level  analysis  to  aid  in  the  joint 
assessment  of  the  track  quality.  CM  fusion  enables  the 
estimation  of  the  combined  quality  of  the  distributed 
tracking  scenario  and  can  be  used  for  any  fidelity  metrics 
based  on  cardinality.  In  a  distributed  multisensor 
multitarget  scenario,  we  demonstrate  the  fidelity  metric 
CM  fusion  for  enhanced  tracking  performance  evaluation. 
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1  Introduction 

In  a  dynamic  targeting  scenario,  there  are  hosts  of 
algorithms  that  affect  performance:  sensor  registration, 
measurement-to-track  (M2T)  assignment,  track-to-track 
(T2T)  association,  sensor  management,  and  ultimately,  the 
user.  In  many  operational  contexts,  the  platform,  sensor, 
and  algorithms  for  target  tracking  and  identification  (ID) 
are  designed  together  which  requires  novel  metrics  for 
distributed  tracking  [1],  Based  on  M2T  algorithms  [2,  3], 
tracking  evaluation  [3,  4],  T2T  developments  [5,  6],  and 
simultaneous  tracking  and  ID  (STID)  approaches  [7,  8,  9, 
10],  we  seek  a  method  for  distributed  tracking  evaluation. 

The  goal  of  target  tracking  is  to  associate 
measurements  of  moving  objects.  There  are  many  tracking 
approaches  that  we  overviewed  in  previous  publications 
[11]  that  included  linear  and  nonlinear  as  well  as  Gaussian 
and  non-Gaussian  approaches  [12].  The  focus  has  been  on 
comparative  analysis  of  tracking  approaches  with  interest 
in  metrics  and  performance.  Examples  of  approaches 
have  been  developed  for  applications  [13],  radar  GMTI 
and  HRRR  tracking  [14,  15,  16,  17]  and  the  nonlinear- 
estimation  toolbox  [18,  19,  20]. 

In  Fusionll,  we  overviewed  many  contributors  to 
both  tracking  approaches  and  metrics  for  tracking 
performance  evaluation  (TPE)  [21].  Highlighted  were  the 
contributions  from  K.  C.  Chang,  and  S.  Mori,  and  C.  Y. 
Chong  [22,  23,  24]  along  with  X.  R.  Li  [25],  of  which  a 
series  of  TPE  contributions  have  been  reported.  In  2011, 
tracking  metrics  were  overviewed  [26]  with  fidelity 
metrics  [27,  28].  Fidelity  track  metrics  include  the 


cardinality  rankings  as  many  of  the  fidelity  metrics  are 
normalized  without  units.  The  fidelity  metrics  include 
such  issues  as  track  association  that  we  use  here.  For  the 
analysis,  we  use  the  track  purity  [29]  as  method  for  track- 
to-track  association,  with  the  interest  of  distributed  fusion 
analysis.  However,  we  need  to  preface  the  distributed 
track  fusion  evaluation  concept  based  on  the  operational 
need. 

From  a  collection  of  tracking  information  from 
different  platforms  (e.g.  aerial),  there  is  an  operational 
constraint  forcing  distributed  tracking.  From  Figure  1, 
there  are  three  types  of  fusion  capabilities  of  signal, 
feature,  and  decision.  [30]  While  there  is  an  interest  to 
process  all  the  data  in  signal-level  fusion,  such  as  image 
fusion  [31],  the  transmission  of  the  data  is  limited  by 
communications  bandwidth.  For  feature  analysis,  there  are 
concerns  of  feature  definitions,  classifier  coordination,  and 
robust  methods  of  distributed  feature-level  fusion  analysis. 
[32,  33]  Recently,  Mori  and  Chong  [34]  developed  a 
usefully  assessment  of  feature-level  fusion  for  tracking 
and  ID.  Since  many  tracking  platforms  are  designed  with 
the  classification  and  ID  analysis  processed  on-board, 
information  is  preprocessed  and  sent  to  the  fusion  center 
for  decision-level  fusion  [35]  without  sending  signal  or 
feature  data.  The  reports  would  indicate  the  measurements 
(e.g.  detections),  with  the  notions  of  allegiance  ID. 
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Figure  1.  Signal,  Feature,  and  Decision  Fusion. 


For  situation  assessment  [36],  there  is  a  need  for 
distributed  TPE  of  the  operating  conditions  of  sensors, 
targets,  environments,  and  algorithms  [37].  In  addition, 
TPE  includes  target  detection,  recognition  (type), 
classification  (category),  and  identification  (allegiance). 
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The  coordination  from  detection  to  identification  (and 
fingerprinting)  is  to  assess  the  target  features  for  target 
type,  category,  and  allegiance  from  both  the  target 
signature  and  the  target  movements  to  distinguish  which 
target  -  if  there  are  related  signatures.  TPE  includes  many 
challenging  tracking  scenarios  such  as  highly 
maneuvering  and  dense  target  environments. 

Key  developments  in  methods  for  STID  include  the 
joint-belief  probability  data  association  filter  (JBPDAF) 
[10],  interacting  multiple  model  (IMM)  [38,  39],  set-based 
IMMJPDA  [40],  multiple  hypothesis  tracker  (MHT)  [41], 
nonlinear  methods  [42,  43,  44]  and  evidential  reasoning 
methods  [10,  45].  Performance  evaluation  for  current 
nonlinear  methods  is  needed  to  address  environmental 
constraints  [46,  47],  optimal  algorithm  parameters  [48,  49, 
50],  and  methods  that  aid  sensor  management  [51,  52] 
such  as  in  a  distributed  scenario. 

The  track-to-track  distributed  assessment  utilizes  a 
track  history  (i.e.,  tracklets  or  small  tracks)  [13,  53]  which 
requires  association  of  the  small  tracks  into  the  general 
TPE  [54].  Distributed  tracking  can  be  done  from  the 
sensors-to-targets  or  moving-target  to  stationary  platforms 
[55].  We  thus  perform  individual  track  assessments  to 
determine  the  track  purity  from  each  platform,  from  which 
we  can  conduct  a  distributed  track  purity  assessment  using 
the  confusion  matrix  (CM)  fusion. 

CMs  are  used  extensively  in  target  ID  assessment 
which  occurs  in  STID  methods  [56,  57,  58].  For  the  case 
of  the  decision-level  fusion  (DLF)  [35,  37,  59,  60]  we 
have  developed  a  method  for  confusion-matrix  fusion  [61] 
but  it  can  also  be  used  in  the  track-to-track  assessment  for 
distributed  applications. 

This  paper  develops  the  CM  distributed  fusion  TPE 
using  the  CM  for  track  purity  combination.  Section  2 
describes  the  tracking  metrics.  Section  3  overviews  the 
JBPDAF.  Section  4  describes  the  CM  DLF.  Section  5 
shows  a  performance  analysis  for  a  multisensor 
multitarget  scenario  and  Section  6  draws  conclusions. 


2  Tracking  and  Estimator  Metrics 

Tracking  methods  include  many  opportunities  for  analysis. 
Some  metrics  are  listed  below:  [3] 


Metric 

Absolute  Track  Quality 

Relative  Track  Quality 

Track  Life-Time 
Relative  Track  Life-Time 

Track  Length 
Relative  Track  Length 

Track  Purity 

Track  Density 
Track  Continuity 


Description 

Mean  square  position,  velocity, 
acceleration  error 

Mean  square  kinematic  error  relative  to 
sensor  covariance 
Total  time  target  is  in  track 
Total  time  target  in  track,  relative  to  length 
of  track-lets 

Distance  over  which  target  is  tracked 
Distance  over  which  target  is  tracked 
relative  to  maneuverability 
Percent  of  associations  of  dominant  track 
over  lifetime 

Number  of  targets  track  per  area 
Number  of  individual  targets  associated 
with  a  given  track 


We  have  organized  the  tracking  metrics  into  two  types: 
accuracy  and  fidelity  metrics  [27].  For  information  fusion 
performance  evaluation,  tracking  is  one  element  in  object 
assessment.  We  plot,  in  a  Fishbone  diagram  [62,  63]  in 
Figure  2,  the  five  Quality  of  Service  (QOS)  information 
fusion  metrics:  accuracy,  throughput,  timeliness, 
confidence,  and  cost. 


Nonlinear. 


Figure  2.  Tracking  and  Identification  Joint  Association. 

2.1  Track  Purity 

Track  purity  (TP),  a  concept  coined  by  Mori  et.  al.  [29], 
assesses  the  percentage  of  correctly  associated 
measurements  in  a  given  track,  and  so  evaluates  the 
association/tracking  performance.  The  TP  measure  of 
performance  (MOP)  is  not  explicitly  dependent  on 
detection  performance,  but  it  is  dependent  on  the  setting  of 
association  gates  (which  depends  on  the  probability  of 
detection  Pd)  and  the  ground  truth  platform  density.  TP 
measures  the  consistency  with  which  a  track  is  updated 
with  measurements  from  a  single  ground  truth  platform  or 
a  distributed  set  of  ground  truth  platforms. 

Correctional  local  MOPs,  such  as  TP,  measure  how  well 
the  tracks  are  being  associated  with  measurements  of 
ground  truth  platforms.  The  TP  MOP  is  based  on  the 
calculation  of  a  confusion  matrix  C  for  which  the  elements 
Cji  are  constructed  by  counting  reports.  Given  the  tracks  lt 
,  tb  and  a  set  of  ground  truth  platforms  gi ,  ....  ga  ,  C  is: 
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Here,  C,,  is  the  number  of  reports  originating  from 
ground  truth  platforms  gj  which  were  assigned  to  track  tj  (i 
=  1,  a;  j  =  1,  ....  b)  by  the  tracker.  Also,  C0i  (the 
“ambiguity  vector”)  consists  of  the  number  of  reports  that 
could  not  be  assigned  to  any  ground  truth  platform  (i  =  1, 
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....  a).  When  C/Y  is  large,  a  strong  association  between  tj 
and  gj  is  implied. 

The  TP  measure  can  be  estimated  for  each  single 
track,  but  is  more  meaningful  when  statistics  of  the  TP 
quantity  are  calculated.  A  recommended  statistic  is  the 
Weighted  Average  of  Track  Purity  (WATP)  [21]  taken 
over  all  tracks  and  ground  truth  platforms.  The  WATP 
statistic  should  be  calculated  separately  for  each  platform. 
It  has  a  particularly  convenient  form  if  the  weight  given  to 
each  track  is  the  number  of  measurements  for  that  track, 
and  if  the  weight  given  to  each  ground  truth  platform  is 
the  number  of  measurements  originating  from  that  ground 
truth  platform.  The  resulting  definition  of  the  WATP,  for 
track  tj,  is  as  follows: 

max ;  r 

j  i 

WATP \tj\  =  -  (1) 

I  I  Cji 

i  =  1  i  =  1 

The  following  elements  are  needed  to  compute  Track 
Purity  or  WATP:  the  list  of  correct  (CO)  track  numbers 
for  which  TP  will  be  computed  (provided  by  the 
operator),  the  valid  time  and  the  ground  truth  platform 
number  to  which  the  CO  track  is  attached,  and  the  time 
stamp  and  the  ground  truth  platform  number. 

The  CM  is  the  starting  point  of  many  MOPs  and  its 
construction  requires  a  lot  of  computation.  Basically,  we 
have  to  associate  each  correct  track  report  to  a  target  in  the 
ground  truth.  The  choice  of  association  can  be  determined 
from  positional  and/or  ID  data.  The  association  will  take 
as  argument  a  track  T  at  the  time  t,  and  the  complete  lists 
of  tracks  and  ground  truth’s  targets  resulting  in  a  CM. 
Here  is  a  procedure  to  construct  the  confusion  matrix: 

a.  Collect  data  to  have  all  CO  track  reports  for  each  track  and 

each  history  point  of  all  targets  in  the  ground  truth, 

b.  Initialize  the  CM  by  filling  each  entry  with  zeros, 

c.  For  each  track,  process  all  CO  track  reports  by: 

1)  Using  an  association  function,  find  the  corresponding 

target  in  the  ground  truth,  and 

2)  Adding  1  to  the  related  entry  of  the  confusion  matrix. 

3  Track  and  ID  Data  Filtering 

Kalman  filters  are  the  baseline  for  tracking  and  are 
optimal  if  the  process  and  measurement  equations  are 
linear  and  the  noise  is  Gaussian.  To  enhance  the  tracker 
performance  in  clutter,  detection  can  be  improved  with 
classification  information;  however  there  is  a  need  to 
associate  measurements  to  multiple  tracks.  We  thus  use 
the  JBPDAF  using  classification  information  from 
evidential  reasoning  for  a  belief  filter  to  determine  ID. 

3.1  Belief  Filter  for  Simultaneous  Tracking  and  ID 

Consider  an  environment  in  which  a  multiple  platforms 
are  monitoring  multiple  moving  targets  with  stationary 
clutter.  By  assumption,  the  tracking  sensor  is  able  to  detect 
target  signatures.  Assume  that  the  2-D  region  is  composed 
of  T  targets  with /features.  Dynamic  target  measurements 


z  are  taken  at  time  steps  k,  which  include  target  kinematic 
and  identification  features  z(k)  =  [x  t  (k),  /n].  Any 

sensor  can  measure  independently  of  the  others,  and  the 
outcome  of  each  measurement  may  contain  kinematic  or 
feature  variables  indicating  any  target.  A  final  decision  is 
rendered  as  to  which  [x,  y ]  measurement  is  associated  with 
the  target-type.  The  multilevel  feature  fusion  problem  is 
formulated  and  solved  by  using  the  JBPDAF  [10].  For  the 
symmetric-target  case,  the  "association  rule"  uses  the 
measurement  with  the  highest  target  probability. 

The  target  state  and  true  measurement  are  assumed  to 
evolve  in  time  according  to: 

x(k  +  1 )  =  F(k)  x(k)  +  \(k)  (2) 

z( k)  =  H(/t)  x(k)  +  w(k)  (3) 

where  \(k)  and  vv(/c)  are  zero-mean  mutually  independent 
white  Gaussian  noise  sequences  with  known  covariance 
matrices  Q(/c)  and  R(k),  respectively.  We  assume  each 
target  has  a  separate  track  (multiple  state  equations), 
initialized  at  an  initial  state  estimate  x(0),  contain  a  known 
number  of  targets  determined  from  the  scenario,  and  have 
associated  covariances. 

The  JBPDAF  devotes  equal  attention  to  every  validated 
kinematic  or  ID  measurement  and  cycles  through 
measurements  until  a  believable  set  of  object  IDs  is 
refined  to  associate  one  object  per  track.  The  belief 

measurement  Belk  =  M  •  Belk_|,  derived  from  the 
classification  data,  represents  the  belief  update  states  of 
the  ID  measurements.  The  M  matrix  is  the  Markov 
transition  matrix,  which  represents  the  similarity  of 
objects.  The  similarity  of  objects  represents  how  the  belief 
in  an  object  type  may  be  related  to  other  objects  of  the 
same  or  different  type. 

The  M2T  association  probabilities  are  computed 
across  the  objects  and  these  probabilities  are  computed 
only  for  the  latest  set  of  measurements.  The  conditional 
probabilities  of  the  joint  track-ID  association  events 
pertaining  to  the  current  time  k  are  defined  as  9/otk,  where 

0/ot|  is  the  event  that  object  center-of-gravity  measurement 
j  originated  from  object  o  and  track  t,j  =1,  ...,  mk;  o  =  0,  1, 
...,  On,  where  mk  is  the  total  number  of  measurements  for 
each  time  step  and  On  is  the  unknown  number  of  objects. 
Note,  for  purposes  of  tracking  and  ID,  we  define  i=  1,  ...  , 
mk  for  the  entire  measurement  set  while  j  =  1,...,  mk  is  for 
tracking  and  o  =  1 . . .,  mk  is  for  object  ID. 

A  validation  gate  for  each  object  bounds  the  believable 
joint  measurement  events,  but  not  in  the  evaluation  of 
their  probabilities.  The  plausible  validation  matrix',  fi  = 

|  <o  /t  |  is  generated  for  each  object  of  a  given  track  which 
comprises  binary  elements  that  indicate  if  measurement  j 
lies  in  the  validation  gate  of  track  t.  The  index  t  =  0 
represents  "the  empty  set  of  tracks"  and  the  corresponding 
column  of  Q  includes  all  measurements,  since  each 
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measurement  could  have  originated  from  clutter,  false 
alarm,  or  true  object  [10]. 

For  a  track  event,  we  have: 

I cL(0)|  - (  i  lf0ie0;[z]kC'  (4) 

J  {  0  otherwise 

where  measurement  [z]k  originated  from  track  t 


For  an  ID-belief  event,  which  is  above  a  predetermined  ID 
threshold, 

I  ©00(6)1  4  {  1  lf  0°°  G  0’ [Bd]0k  °  °  (5) 

[  0  otherwise 

where  measurement  [Bel]ok  is  associated  with  object  o. 

Since  the  JBPDAF  is  tracking  multiple  objects,  o, 
assuming  one  for  each  track,  t,  it  has  to  determine  the  ID- 
belief  in  each  object  from  a  known  database  comparison. 
While  these  IDs  are  processed  over  time  to  discern  the 
object,  for  each  measurement,  JBPDAF  must  determine  if 
the  track-ID  measurements  are  plausible.  JBPDAF  uses 
the  current  ID-beliefs  to  update  the  association  matrix.  If 
the  belief  in  the  object  is  above  a  threshold,  JBPDAF 
declares  the  measurement  i,  to  be  plausible  for  the  target. 

3.2  Data  Association 


Since  we  have  assessed  the  continuous-kinematic 
information  and  the  discrete-classification  event,  we  can 
now  assess  the  intersection  of  kinematic  and  ID 
information  for  STID.  Note,  ID  goes  beyond  object 
detection,  recognition,  and  classification,  to  associate  two 
objects  of  the  same  class  with  a  specific  track.  A 
kinematic-ID  joint  association  event  consists  of  the  values 
in  £2  corresponding  to  the  associations  in  0/ot, 


co 


yot 


(0)1  - 


1  if  0,0,  e  0  * 
0  otherwise 


(6) 


where  (*)  measurement  [z]k  originated  from  track  t  with  a 
[Bel]ok  for  a  given  Oo1  and 


%ot(0)  =  %t(0)  ®  ®oo(0)- 


(7) 


and  rows  for  measurements.  These  generalized  equations 
propagate  ID-filtered,  predicted  ID  measurements  in  time. 
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Figure  3.  Tracking  and  Classification  Joint  Association. 

JBPDAF  processes  event  matrices  with  an  “AND” 
function  in  the  case  of  joint  association  allowing  for 
plausible  events  from  either  the  track  or  classification.  To 
determine  the  event  plausibility,  JBPDAF  uses  the 
validation  region  for  track  measurements  and  uses  a 
threshold,  or  classification  gate,  to  determine  a  target-type 
ID  match  associated  with  a  given  track.  Figure  4  illustrates 
the  “AND”  function.  Note,  JBPDAF  rejects  non- 
believable  measurements  and  measurements  that  lie 
outside  the  kinematic  validation  gate. 
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Figure  4.  Believable  Events  for  the  association  matrix. 


JBPDAF  sets  up  the  state  and  probability  values  for 
the  determination  of  the  weights  assigned  to  these 
associations.  A  track-ID  association  event  has  [2] 

i)  A  single  object-type  measurement  from  a  source: 

o 

t  %o,(e;:ot)  =  1  vy  (8) 

o=0 


Note,  we  define  the  indices  as  jot  since  O  is  the  number  of 
objects  which  is  equal  to  the  number  of  tracks. 

These  joint  events  will  be  assessed  with  “(3”  weights  [2] 
to  determine  the  extent  of  belief  in  the  associations.  To 
process  the  believability  of  track  associations,  augmented 
with  the  ID  information,  we  set  up  a  matrix  formulation. 
For  example,  we  have  a  set  of  kinematic  measurements  z( 
with  a  Bel0  and  put  them  into  the  event  association  matrix 
as  illustrated  in  Figure  3.  The  upper  left  of  a  box 
represents  the  track  information  where  a  “1”  indicates  the 
kinematic  measurement  lies  within  a  gated  position 
measurement.  The  lower  right  represents  the  belief  in  an 
object  type  of  any  class  except  the  unknown  class  where  a 
believable  object  receives  a  “1”.  Columns  are  for  tracks 


ii)  And  at  most  one  object-type  measurement  ID 
originating  from  a  object  for  a  given  track: 

mk 

¥0)=I  %ot(0jot)  (9) 

j=  i 

The  event  matrices,  Q  for  each  track,  corresponding  to  ID 
events  can  be  done  by  scanning  £2  and  picking  one 
unit/row  and  one  unit/column  for  the  estimated  set  of 
tracks  except  for  t  =  0.  In  the  case  that  JBPDAF  has 
generated  event  matrices  for  an  estimated  number  of 
tracks  with  different  object  types,  JBPDAF  needs  to  assess 
the  combination  of  feature  measurements  to  infer  the 
correct  number  of  tracked  objects  that  comprise  the  set. 
The  binary  variable  5/  0/otk)  *s  called  the  track  detection 

indicator  [2]  since  it  indicates  whether  a  measurement  is 
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associated  with  the  object  o  and  track  t  in  event  0,,,,, .  i.e. 

whether  it  has  been  detected.  The 
association  indicator 

mk 


7otk’ 
measurement 


(10) 


X/®/otk)  -  2]  %ot(  ®/otk) 
i  =  i 

indicates  measurement  j  is  associated  with  the  track  t  in 
event  0yotk-  The  false  measurements  in  event  <9  are: 


<t>(0)  =  I  [  1  -  t/0)  ]  (11) 

7-1 

The  joint  association  event  probabilities  are,  using  Bayes' 
formula: 


Since  Sk  is  the  innovation  covariance  update,  we  can  use  Sk 
to  gate  measurements  based  on  the  uncertainty  with  the 
associated  track  and  IDs. 

Validation:  At  k,  two  measurements  are  available  for 

T  T 

object  o  for  a  given  track  t\  zk.1;  and  zk,  from  which 
position,  velocity,  pose,  and  ID  features  can  be  extracted 
from  the  belief  track  vectors.  Validation,  based  on  track 
and  ID  information,  is  performed  to  determine  which  track- 
belief  measurements  fall  into  the  kinematic  region  of 
interest: 

(4-4-l)T  rsk|_'  (Jk-4|k-r)-'y  for  (15) 


P{e(/r)|ZA}  =  P{6(/t)|Z(A:),m(A:),ZA-1} 

=  ~cV\Z{k)  |  mMk)ZkA\  P{0(&)  |  m(*)} 

,  m(*)  -  <t>(k) 

=  -  n  ym)[zJmTj  (12) 

c  j-i  * 

where  c  is  the  normalization  constant. 

The  number  of  MIT  assignment  events  9(£)  is  the  number 
of  targets  to  which  a  measurement  is  assigned  under  the 
same  detection  event  [  m(/c)  -  <)>].  The  target  indicators 
8t(  9)  are  used  to  select  the  probabilities  of  detecting  and 
not  detecting  events  under  consideration. 

3.3  Fused  Track  and  ID  State  Estimation 

Assuming  the  targets  conditioned  on  the  past  observations 
are  mutually  independent,  the  decoupled  state  estimation 
uses  the  marginal  association  probabilities,  which  are 
found  from  the  joint  probabilities  by  summing  all  the  joint 
events  in  which  the  marginal  track  and  classification 
events  result.  The  beta  weights  [2]  are: 

P/Ok  =  P1V  I  =  2  P{0,-O<k  I  Z *}®;o(0;o<k)  (13) 

0 

JBPDAF  decomposes  the  object-state  estimation  with 
respect  to  the  object  location  of  the  latest  set  of  validated 
belief-set  and  kinematic-set  measurements.  For  each  object 
measurement,  we  use  the  total  probability  theorem  to  get  the 
conditional  mean  of  the  state  at  time  k  as: 

o 

A  ^  A  ■ 

Xk|k  =  2  Xk|k  Pk  >  (14) 

i-0 

where  Xk*k  is  the  updated  state  conditioned  on  the  event  that 
the  i,h  validated  object  measurement  is  correct  for  track  t. 
The  covariance  propagation  for  each  track  t  is: 

pk|k-i  =  FLi  pLi  (FLi)T  +  Qk-i> where  Q  k  = 

We  can  obtain  the  innovation  covariance  Sk  with  the 
associated  Rk  and  measured  Dk  by: 

<  =  <fPkM  (H^)T  +  Rk,  where  Rk  = 


Rk  0 
0  Dk 


Qk  o 

0  Bk 


where  y  is  a  validation  threshold  obtained  from  a  j}  table 
and  Sk  stands  for  the  largest  among  the  predicted  track 

belief  covariance,  i.e.,  det(Sk)  >  det(Sk)  for  t  =  1,  2 ,...,« 
where  n  is  the  number  of  states.  The  combined  predicted 
track  belief,  2k|k_  j ,  is  given  by  E{zk\  { jf}S0  =  h  Zk~1}  where  s 
is  the  set  of  object  beliefs  for  a  track. 

Data  association  for  (3^  :  Data  association  performed  for 
each  belief  object-track  is  similar  to  that  in  PDA  and  the 
details  can  be  found  in  [2]  for  the  association  probabilities 

for  /  validated  object  measurements  ml,  PG  assessing  the 
probability  that  augmented  belief  track  measurements  fall 
into  the  validation  region,  and  PD  representing  a  detection 
probability.  For  the  JBPDAF  case,  we  vary  the  innovation 
covariance  (Sk),  PD,  PG  proportionally  to  the  sensor 

manager  collection  resolution  (i.e.  higher  resolution  — > 
higher  PD,  higher  PG,  and  lower  Sk).  The  lower  Sk  for  the 
higher  resolution  is  a  result  of  changing  the  prediction, 
which  results  after  a  few  track  instances.  The  volume  of  the 
validation  gate  is 

vk  =  cd  yd/2|Sk|1/2,  (16) 


where  Cd  is  the  unit  hypersphere  volume  of  dimension  d, 
the  dimension  of  the  augmented  belief-track  measurement. 


Kinematic  belief-probabilistic  update:  The  object 
belief-probabilistic  track  update  is  performed  as  a  full  rate 
system  to  combine  the  state,  innovation,  and  covariances. 


XA:|k-Xk-l|k-l  +  Wk  X  P  Ik^lk 

/=  l 


and  Vk\k~  Po  P/J'-  ’  + 


k\k-\  1  (!  "  Po)  Vk\k~ 


W, 


I  P//tv/A-[%-]T-vA-[vA-]T 
.1=1 

where,  Pk{k  =  [  I  Wk  ]  P^.j 


K)T 


(17) 


(18) 

(19) 


o 

mk 

K  =  pk|k-l  [Hkf  (Sk)4  and  v,  =  I  p/k  v|k  (20) 

/=  1 
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(25) 


where  H, '  is  the  measurement  matrix  that  is  calculated  for 

k 

each  object  pose,  <|>,  and  estimated  position  of  track  t. 


4  Decision  Level  Fusion  (DLF)  Method 

The  WATP  decisions  are  stored  in  a  CM.  For  initial 
track  performance,  these  estimates  are  treated  as  priors 
[61].  Decisions  from  multiple  platforms  with  different 
geometric  perspectives  are  fused  using  the  Decision  Level 
Fusion  (DLF)  technique.  Assume  that  we  have  two 
platforms  each  with  a  WATP  described  in  a  CM 
designated  as  CA  and  CB.  The  elements  of  a  CM  are  c  jj  = 
Pr{  WATP  decides  track  object  Oj  when  track  object  o,  is 
true},  where  i  is  the  true  object  track.  j  is  the  assigned 
track  class,  and  i  =  1,  . ...,  N  for  N  true  tracks.  The  CM 
elements  can  be  represented  as  probabilities  as  Cjj  =  Pr{  z 
=j  I  °i}  =P{  zj  I  °i}-  To  determine  an  track  declaration,  we 
need  to  use  Bayes’  rule  to  obtain  p{o ;  |  zj}  which  requires 
the  track  priors,  pio,}.  We  denote  the  priors  and 
likelihoods  as  column  vectors: 


pip  l) 

pi?  j 

|oi) 

P(Ol ) 

;  p(zi\ o)  = 

pi2  j 

|o2) 

p(o)  = 

-  Aon)  - 

-  p(z  j 

oN)  - 

•  (21) 


For  M  decisions,  a  confusion  matrix  would  be  of  the  form 


P(z  i ]  °i)  P(zi\oi) 
p{z  i  |  02)  p{z  2  |  02 ) 


p(zM\  Oi) 
p{z  M  |  Ot) 


L  p(z  ,  |  oN)  p{z2\o^)  ••  p{zM\on)  J 


The  joint  likelihoods  are  similar  column  vectors,  where  we 
assume  independence  for  two  confusion  matrices  A  and  B 
(denoted  here  as  superscripts), 


P(z  t’zk\  o ) 


P(z fl  o{)  •p{zl\ox) 
p(z^\°2)  •  AZ  k  I  02) 


,  (23) 


A  B 

p(z j  I  On)  •  Azk  I  0N)  J 


where  k  is  used  to  distinguish  between  the  different 
assigned  object  tracks  between  the  two  confusion  matrices 
when  the  CMs  are  not  symmetric.  The  independence 
assumption  is  valid  if  the  sensors,  decision  analysis,  or  the 
noise  from  sensor-to-target  perspectives  are  different. 

Using  the  priors  and  the  likelihoods,  we  can  calculate  a 
posteriori  from  Bayes’  Rule 

b,  _  p(z jVzk  1  o)  P(P) 

Z  P(z  f,zk\  o)  p(o) 
i=  1 


A  ^ 
pip  |Zj  ,Zk): 


(24) 


Note  that  there  are  similar  column  matrices  for  the 

_  _  A  B 

posteriors  p(o  |  z  j )  and  p(o  \  z  ■.  ,  z  k).  A  decision  is  made 
using  the  maximum  likelihood  estimate 


d ;  =  argmax  p(o  ,  |  zj\  z”)  , 
j;k 

where  the  final  decision  of  the  true  object  track  i  is 
determined  from  the  largest  value  from  the  vector. 

Note  that  the  subscripts  indicate  the  value  of  a  variable 
and  the  superscripts  indicate  the  track  source.  For 
example,  zA  =  z3  indicates  that  tracker  A  made  a  decision 
z3;  where  tracker  A  might  be  the  first  track  and  decision  z3 
might  be  track  type.  The  absence  of  a  superscript  implies 
an  unspecified  single  source.  We  represent  the  particular 
states  from  each  tracker  with  the  subscripts  a  and  b  such 

as  z  A  =  z  f  indicating  that  tracker  ^4’s  decision  was  z  a. 

For  the  developments  of  the  pseudo  code,  shown  below 
in  Figure  5,  we  shorten  the  notation  to  zA  =  za,  while 
keeping  an  update  of  the  CM  source  A  or  B.  Inputs  to  the 
fuser  are  the  decisions  of  trackers  A  and  B ,  i.e.,  za  and  zb 
respectively.  The  output  decision  d  is  based  on  a 
maximum  a  posteriori  probability  (MAP)  decision  rule, 

where  p(o  \  z  a,  z  b)  is  posterior,  p(o)  is  the  prior 
probabilities,  and  CA  and  CB  are  the  WATP  CM  (one  for 
each  source). 


function  [d,  pObarZaZb]  =  fuseCMdecisions(za,  zb,  Obar) 

CA  =  getConfusionMatrix(  1 ); 

CB  =  getConfusionMatrix(2); 

pZaObar  =  CA(:,za); 

pZbObar  =  CB(:,zb); 

pZaZbObar  =  pZaObar  .*  pZbObar; 

posteriorNum  =  pZaZbObar  .*  pObar; 

posteriorDen  =  sum(posteriorNum); 

pObarZaZb  =  posteriorNum  /  posteriorDen; 

[junk,  d]  =  max(pObarZaZb); 
return 

Figure  5.  Pseudo  code  for  DLF  with  Confusion  matrix. 

Pseudo  code  for  DLF  is  represented  as: 

•  za  =  za  and  zb  =  zb  are  the  integer  decisions  between  1  ...  M 

of  trackers  A  and  B,  respectively 

•  pObar  =  p(o )  is  a  vector  of  priors,  represented  as  either 

constants  or  input  variable 

•  CA  =  CA  and  CB  =  CB  are  the  confusion  matrices  derived 

from  trackers  A  and  5,  respectively 

•  pZaObar  =  />(za  |  o)  and  pZbObar  =  p(z b  |  o)  are  the 

likelihoods  as  extracted  columns  from  the  confusion 

matrices  [pZaObar  =  CA(:,za);  and  pZbObar  =  CB(:,zb)] 

•  pZaZbMbar  =  p(za ,  zb  \  o)  is  the  joint  likelihood  derived 

from  the  point-wise  product  of  the  tracker  likelihoods 

(pZaZbObar  =  pZaObar  .*  pZbObar); 

r-  ,  ,  P(z  a,  z  b  I  o)  p(o) 

•  pObarZaZb  =  p(o  \  z  a,  z  b)  =  ^ 

Z  P(z  a,  Z  b  I  d)  p(o) 

i=  1 

-  the  numerator  is: 

posteriorNum  =  pZaZbObar  .*  pObar; 

-  the  denominator  is: 

posteriorDen  =  sum(posteriorNum); 

-  pMbarZaZb  =  posteriorNum  /  posteriorDen; 


2017 


•  d  =  max(pObarZaZb),  which  is  the  fused  decision,  d ,  3  p(o  , 
ka,^b)^Koilza,Zb)  V  i,  j  where  i,  j  e  1,  ...,7V. 

5  Distributed  Performance  Analysis 

For  this  analysis,  we  first  developed  a  toolbox  of 
performance  evaluation  methods  [18-20].  We  compared 
multiple  scenarios  for  analysis  of  closely  spaced  targets 
with  linear  and  nonlinear  movements.  Here  we  present 
the  case  of  the  nonlinear  motions  to  demonstrate  a 
distributed  track  fusion  assessment  using  the  belief  filter. 
Figure  6  shows  the  scenario  with  clutter  and  Figure  7 
shows  the  resulting  track  outputs  from  one  sensor. 

The  scenario  was  generated  using  the  trajectories 
shown  and  variations  in  the  clutter.  Two  elements  of 
clutter  can  be  induced  from  the  spurious  measurements  for 
a  sensor.  Since  distributed  sensors  have  different 
perspectives,  the  measurement  clutter  was  altered  relative 
the  perspective.  For  example,  Sensor  2  has  a  better 
perspective  of  Target  3,  which  has  a  higher  WATP. 

x  -jo  Measurements  (wth  clutter) 

1.05 
1.04 
1.03 
1.02 
1.01 


0.98 
0.97 
0.96 
0.95 
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X 

Figure  6.  Scenario  with  Clutter. 
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Figure  7.  Sensor  1  track  result  with  covariances. 


Figure  8  and  9  show  the  CM  for  the  individual 
sensors  and  the  DLF  combined  result  (using  the  method 
shown  in  Section  4  [61])  which  improves  the  distributed 
track  purity  assessment.  It  is  noted  that  the  use  of  the  CM 
fusion  does  improve  the  overall  assessment  (sum  of 
diagonals),  but  may  result  in  poorer  performance  for  a 
case  in  which  a  closer  sensor  has  a  better  STID  analysis 
(as  noted  from  Sensor  1,  Track  1  going  from  0.98  to  0.97). 
Future  work  requires  a  more  intelligent  method  of  score 
fusion  over  different  scenarios  to  improve  distributed 
analysis  based  on  the  credibility  of  the  sensor/track 
outputs.  For  example,  more  significant  degradations 


happen  when  fusing  a  result  with  0.98  and  0.50,  of  which 
relying  on  0.98  should  be  the  choice  for  a  more  credible 
sensor.  Other  concerns  relate  to  different  CM  sizes,  sensor 
update  rate,  and  track  algorithm  choice,  which  all  affect  a 
distributed  track  fusion  analysis. 
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Figure  8.  WATP  CM  from  Sensor  1  and  Sensor  2. 
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Figure  9.  Fused  WATP. 

6  Discussion  and  Conclusions 

Building  on  many  developments  in  track  performance 
evaluation,  we  developed  a  metric  for  distributed  track 
fusion  assessment  by  integrating  track  purity  from  track 
segments  from  distributed  platforms.  We  used  the  novel 
confusion-matrix  fusion  approach  for  the  analysis.  Future 
work  will  explore  metrics  for  sensor  management,  net- 
centric  solutions,  nonlinear  trackers,  and  exploration  of 
non-physics-based  tracking  scenarios  such  as  social 
networks  [64],  of  which  newer  methods  are  needed. 
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